Dynamo Snapshot

mentions 2 type Person feed RSS

// recent coverage 2 mentions

10:23

2026-06-05

marktechpost.com

ai-infrastructure

NVIDIA AI Releases Dynamo Snapshot: A CRIU-Based Fast Startup System for AI Inference on Kubernetes

NVIDIA AI released Dynamo Snapshot, a checkpoint/restore system using CRIU and cuda-checkpoint to eliminate cold-start delays for AI inference workloads on Kubernetes. The system freezes a running inf…

22:07

2026-05-30

github.com

large-language-models

Show HN: Thaw – Git branch for a running LLM (fork agents, skip prefill)

A developer released Thaw, an open-source tool that snapshots a live large language model inference session to create forked branches without re-running prefill, addressing the computational waste of …

// co-occurs with top 8 entities

vLLM 2 NVIDIA 2 thaw 1 SGLang 1 Llama-3.1-8B 1 H100 1 LangGraph 1 CRIU 1